Content creation, graphical user interface system and display

ABSTRACT

The present invention relates to creating a web page and voice browsing of the web page, and more particularly, it improves accessibility for the voice browsing of the web page through a synthetic voice, efficiently with high reliability. 
     A content creation system  20  of the present invention is used for creating a content which may be viewed through the synthetic voice, the system including: a database  22  for storing a structured document; and an information process section  24  for creating a speech node series  18  from the structured document, and calculating a reaching time from starting voice synthesis of the speech node series  18  until each node is outputted as the synthetic voice. The information process section  24  includes a support process section  36  to determine a graphic display corresponding to the reaching time, and to visually display the reaching time to a predetermined node by the voice synthesis on a screen of a display section  26.

CROSS REFERENCE AND PRIORITY

This application filed under 35 USC 371, is cross-referenced with, andclaims priority from, International patent application JP2004/006229filed on Apr. 28, 2004, and published in Japanese with PublicationNo.PCT WO 2004/097656 A1 on Nov. 11, 2004, under PCT article 21(2),which in turn claims priority of JP2003-125147, filed on Apr. 30, 2003.

FIELD OF THE INVENTION

The present invention relates to creating a web page and voice browsingof the web page, and more particularly, to a content creation system, acontent creation method, a program for executing the above describedcontent creation method, a computer readable storage medium havingstored the above described program, a graphical user interface systemand a display control method, for improving user's accessibility to acontent through a synthetic voice.

BACKGROUND ART

In recent years, as network technologies and Internet infrastructurebecome widespread, a computer user has got to display a web pagevisually on a screen of a computer via the Internet and acquire variouskinds of information. In an existing web page creation method, it isconsidered first that the web page provides the user with theinformation visually.

However, with respect to information processability, informationacquirability and quickness thereof in a personal computer, the existingweb page aimed to provide a graphical user interface has been regardedto have various difficulties. For example, typically the web page isdisplayed as the graphical user interface on the screen of the computer.In this case, a user who may not recognize the web page visually(hereinafter, in the present invention, referred to as a non-visualaccess user), may not have enough access to the graphical user interfacedisplayed as the web page, or may not have any access thereto at all,and thereby a disadvantage may occur that the non-visual access usercannot acquire an important content, for example, a main content to beprovided through the web page.

As described above, considering usability of the existing web page fromthe viewpoint of the non-visual access user, it is difficult to say thatthe existing web page has enough accessibility. Reasons therefor mayinclude, for example, that the non-visual access user may not access thecontent directly by using pointers and icons, which have their positionscontrolled by pointer means such as a mouse, a stylus pen, keyboardoperations and a joystick, and are displayed as shapes such as arrowsand the likes; that two-dimensional to one-dimensional spatialrecognitions are completely different from those for a visual accessuser; and that even if the important main content is highlighted, it maynot be recognized by the non-visual access user, and the like.

In order to improve the above described disadvantage even partly,conventionally, a voice response system has been proposed whichgenerates a structured document, such as a text, HTML (Hyper TextMark-up Language), DHTML (Dynamic Hyper Text Mark-up Language), SGML(Standard Generalized Mark-up Language) and XML (extensible Mark-upLanguage), as a synthetic voice via a voice synthesis system, andprovides it for the non-visual access user by means of a microphone.However, navigation only via voice has had a disadvantage that it maynot ensure acquirability of the main content, because it takes a longtime for the above described user to reach the main content amongcontents displayed on the web page, or because the user eventually maynot reach the required content.

In addition, for the above described purpose, in a voice browsingsystem, the voice response system and the like, VoiceXML and the likeare used to create the web page including the content suitable for eachsystem to provide services. However since only limited information isprovided in such services, these systems may not make a vast amount ofinformation on the web available effectively to the non-visual accessuser.

The voice browsing system proposed conventionally, with respect to thenon-visual access user, uses the same browser as that for an ordinaryuser (Internet Explorer® or Netscape Navigator®) to access the web page,by means of a voice browser or a screen reader installed at a user site.The conventional voice browsing system has provided the user with thevoice navigation by extracting only text information which may beoutputted via voice and speaking a file including a word such as “HTML”for example, sequentially from its beginning.

PROBLEMS TO BE SOLVED BY THE INVENTION

Accordingly, a disadvantage may occur that it is very difficult for theconventional voice browsing system to access the information displayedon the web page which has been created for the purpose of visualrepresentation. For example, data having image data or a link to theimage data, would lack some of the information thereof to be spoken, ifrespective alternative texts for such data have not been previouslyprepared. Moreover, in the web page in recent years, the various kindsof information are included in a single page and laid out by means ofvarious visual effects such as a background color or a text color.However, the voice browsing system may not communicate the visualrepresentation such as highlighting or a layout such as coloring.

In this case, as has been known conventionally, with respect to a jumpto the main content, if a link command is inserted at the beginning ofthe web page, non-visual accessibility may be improved significantly. Byselecting this link, the information “having less relation with themain” such as a header and the like, which exists in the beginningdirection in the web page, is skipped, and accordingly it is possible toreach the most important information in the web page quickly. However,under the present circumstances, there are very few web pages includingthe above described command. Additionally, for example, there is a webpage in which a template of the web page includes a structure forprompting the non-visual access from the first. However, there is nopoint in that the link in consideration of the non-visual access onlyexists, and its purpose may not be achieved without describing the linkcompletely on each web page by each content creator.

Under the present circumstances, it is often the case that the web pagegiven the link to the main content has no description of the linkitself, thereby such a web page may not fully achieve a function ofgiving the link. Therefore, it is also known that even if a request isinputted for executing the non-visual access with respect to the linkfor the non-visual access, there are problems that the user is turnedback to the beginning of the web page, or that an error occurs because awrong URL of a jump destination is written. The above described link forthe non-visual access may even lower the accessibility if it does notfunction properly.

It may be considered essentially that the above described disadvantagesarise from a fact that the visual access user creates the web page.Here, in the present invention, the visual access user means thecomputer user who can recognize the web page visually to input andacquire the information. In other words, since the visual access usercan use ordinary browser software to view the web page withoutinconvenience, it may be said that he has hardly experienced the accessto the web page by means of the voice synthesis. Accordingly, it may benatural in a sense that the visual access user doe not conscious of thedisadvantages which often occur in the voice browsing system. Though itis difficult to create all web contents which may be considered atpresent to meet needs of visually impaired persons, as the networktechnologies such as the Internet become widespread in recent years, inview of the fact that even the important information may be acquired onthe Internet, it has been desired to improve the accessibility to themain content by improving the voice navigation with respect to theexisting web contents.

However, based on necessity and importance of improving theaccessibility with respect to the non-visual access user, it may beconsidered that it is possible to improve dramatically tasks by thevisual access user who may become a web page creator, if it is possibleto support more effectively efforts by a home page creator who dealswith modification of the web page to be accessed by the non-visualaccess user.

SUMMARY OF THE INVENTION

The present invention has been made in view of the above describedproblems of the prior art, and made based on a conception in which if itis possible to provide the visual access user visually with theaccessibility for the non-visual access user, it is possible for thehome page creator or the web page creator being the visual access userto provide easily the non-visual access user with the web page havingthe improved accessibility.

In a web page creation of the present invention, for the above describedpurpose, if the voice synthesis is executed at a normal speech speed, areaching time to a node in the structured document is calculated, andthe reaching time is associated with a display position of the node onthe web page and then displayed visually with respect to the home pagecreator or the web page creator.

In one particular embodiment of the present invention, the reaching timeto a content may be estimated by means of a normal word speech speed invoice synthesis software, and the number of words in an appropriatedescriptive language such as a text, HTML, DHTML, SGML and XML, untilthe above described content is specified. In addition, the estimatedreaching time to the content is assigned with a display formatcorresponding to the reaching time and displayed, for example, on ascreen display of the web page or a home page being created. The creatorof the home page or the web page may use the display on the screen toevaluate the access by the non-visual access user.

On the other hand, in a content creation system provided by the presentinvention, the node determined by referring to a graphic display by thecreator of the home page or the web page (hereinafter, in the presentinvention, referred to simply as the creator) is not sent in order of aspeech node series obtained according to a predetermined rule from a DOMtree structure of the structured document, but is edited in response toan input by the creator and sent to the voice synthesis system of thenon-visual access user. The sent structured document regenerates thespeech node series in order specified by the creator with the voicesynthesis software, and is provided as the synthetic voice to thenon-visual access user. In one particular embodiment of the presentinvention, it may be possible to navigate the web page by means of auser's terminal arranged at the non-visual access user's site, in theorder specified by the creator, without changing a visual configurationof the web page significantly, that is, for example, keeping the samevisual display of the web page as that for the visual access user.

Furthermore, in the present invention, it is also possible to use andmodify the web page or the home page which has been created once, and itis also possible to provide easily different accessibilities withrespect to the non-visual access user who is familiar with voicebrowsing and the non-visual access user who is not familiar with thevoice browsing, by having prepared several types of speech speeds andvoice navigations.

Specifically, according to the present invention, a content creationsystem for creating a content which may be viewed through a syntheticvoice is provided, the content creation system including:

-   a database for storing a structured document; and-   an information process section for creating a speech node series    from the structured document, and calculating a reaching time from    starting voice synthesis of the speech node series until each node    is outputted as the synthetic voice.

The information process section of the present invention includes asupport process section for editing the speech node series and acorresponding portion in the structured document. In addition, thesupport process section includes: reaching time calculation means forcalculating a reaching time from creating the speech node series untilthe voice synthesis of a predetermined node is executed; conversiondetermination means for modifying a graphic display at a displayposition of the predetermined node in response to the reaching time, andreceiving a modification command for instructing to modify the reachingtime to the predetermined node; and conversion means for receiving anoutput from the conversion determination means, creating and outputtinga time display mapping table to the outside.

The time display mapping table of the present invention includes thenode, the reaching time corresponding to the node, the display positionof the node and a graphic display value of the node. The conversiondetermination means of the present invention includes means forreceiving the modification command for instructing to modify thereaching time to the predetermined node, and modifying the speech nodeseries and the structured document at an immediately preceding positionof the node specified by the modification command.

According to the present invention, a computer executable contentcreation method for causing a computer to create a content which may beviewed through a synthetic voice is provided, the method including thesteps of:

-   reading a structured document stored in a database;-   creating a speech node series from the structured document;-   calculating a reaching time from starting voice synthesis of the    speech node series until the voice synthesis of a predetermined node    is executed, and associating the node with the reaching time to    store them; and-   reading the reaching time, and with respect to a display section,    giving a graphic display corresponding to the reaching time of the    node.

The storing step of the present invention further includes the step of,with respect to the node, associating a display position of the nodewith a graphic display value of the node to store them. The step ofgiving the graphic display of the present invention includes the step ofmodifying the graphic display at a display position of the node inconnection with the reaching time. The step of modifying the graphicdisplay in connection with the reaching time of the present inventionincludes the steps of: receiving a modification command for the reachingtime to the predetermined node; in response to the modification command,modifying the speech node series and a corresponding structureddocument; recalculating the reaching time in the modified speech nodeseries; and modifying the graphic display of the node in connection withthe recalculated reaching time. Furthermore, the step of modifyingincludes the step of: modifying the speech node series at an immediatelypreceding position of the node of the modification command forinstructing to modify the reaching time to the predetermined node.

According to the present invention, a computer executable program forexecuting the content creation method is provided. In addition, acomputer readable storage medium having recorded therein the computerexecutable program for executing the above described content creationmethod is provided.

According to the present invention, a graphical user interface systemfor creating a content which may be viewed through a synthetic voice isprovided, the graphical user interface system including:

-   parser means for parsing a structured document to generate nodes in    a DOM tree structure;-   means for creating a speech node series from the nodes in the DOM    tree structure, and calculating a reaching time from starting voice    synthesis of the speech node series until the voice synthesis of a    predetermined node is executed; and-   means for determining a graphic display at a display position of the    predetermined node in response to the reaching time.

In the present invention, the system further includes:

-   means for receiving a modification command for instructing to modify    the reaching time to the predetermined node; and-   means for modifying the speech node series at an immediately    preceding position of the node specified by the modification command    and a corresponding portion in the structured document. In the    present invention, the means for calculating the reaching time    recalculates the reaching time using the modified speech node    series; the means for determining the graphic display redetermines    the graphic display in response to the recalculated reaching time    and displays the modified reaching time with the redetermined    graphic display.

According to the present invention, a display control method forfunctioning a computer as a graphical user interface system fordisplaying voice accessibility to a content which may be viewed througha synthetic voice, is provided, the display control method including thesteps of:

-   parsing a structured document to generate nodes in a DOM tree    structure by means of parser means;-   creating a speech node series from the nodes in the DOM tree    structure, and calculating a reaching time from starting voice    synthesis of the speech node series until the voice synthesis of a    predetermined node is executed; and-   determining data including a display position of the predetermined    node in response to the reaching time, and sending the data via a    network to an information terminal.

In the present invention, the method further includes the steps of:

-   receiving a modification command from the network for instructing to    modify the reaching time to the predetermined node; and-   modifying the speech node series at an immediately preceding    position of the node specified by the modification command and a    corresponding portion in the structured document. Furthermore, the    step of calculating the reaching time recalculates the reaching time    using the modified speech node series; the step of determining data    redetermines the graphic display in response to the recalculated    reaching time and sends edited data corresponding to the modified    reaching time with the redetermined graphic display.

BRIEF DESCRIPTION OF THE DAWINGS

FIG. 1 is a schematic flowchart of a content creation method of thepresent invention;

FIG. 2 is a flowchart showing a process in a reaching time calculationsection of the present invention;

FIG. 3 shows an embodiment of a structured document and a schematicembodiment for creating a node reaching time table in the presentinvention;

FIG. 4 shows a schematic functional block diagram of a content creationsystem of the present invention;

FIG. 5 shows detailed functional blocks of a support process section ofthe present invention;

FIG. 6 shows a data structure of a set to be used in a reachingtime-display position mapping, and a display corresponding thereto on ascreen in the present invention, in the case of using a DHTML documentas shown in FIG. 3;

FIG. 7 shows a schematic flowchart of a web page creation support methodof the present invention;

FIG. 8 shows an embodiment for displaying graphically a menu forselecting or determining a display format in the present invention;

FIG. 9 shows an embodiment of a graphical display of the reaching timeto a predetermined element word of the present invention;

FIG. 10 is a flowchart of an exemplary procedure of an edit process forthe structured document in the web page creation support method of thepresent invention;

FIG. 11 shows an embodiment of a graphical user interface to bedisplayed on the screen of a display section by the content creationsystem of the present invention, by executing the content creationmethod of the present invention as explained in FIG. 10;

FIG. 12 shows a screen display in the case where a creator selects tocreate a link for editing;

FIG. 13 shows an embodiment of a graphic display for displayinggraphically the reaching times of a web page in which an appropriatelink to a main content has been created, according to the presentinvention;

FIG. 14 shows an embodiment of another display mode of the reachingtimes which may be employed in the web page creation support of thepresent invention;

FIG. 15 shows an embodiment of the content creation system of thepresent invention, in the case where the above described edit process ismodularized as an authoring tool of a web page creation system;

FIG. 16 shows an embodiment in which a web application for using thepresent invention may be provided;

FIG. 17 shows an embodiment of the graphical user interface to bedisplayed on a display section of a creator's terminal, in the casewhere a web service is provided via a network by the content creationsystem of the present invention; and

FIG. 18 shows an embodiment of a web page creation support system of thepresent invention including service log analysis means.

PREFERRED EMBODIMENT

Though the present invention will be described below with reference tospecific embodiments shown in the drawings of the present invention, thepresent invention is not limited to the specific embodiments as will bedescribed below. FIG. 1 shows a schematic flowchart of a contentcreation method of the present invention. The content creation method ofthe present invention reads a content to be displayed with respect to anon-visual access user, from appropriate storage means, for example adatabase, at step S10. In the present invention, though the content maybe written in various kinds of structured languages such as HTML, DHTML,XML and SGML, the content will be described below as written in DHTML asone particular embodiment, in order to describe the present inventionspecifically. A read structured document is inputted into reaching timecalculation means at step S12, and a reaching time to a predeterminednode is calculated from nodes in the structured document acquired basedon tags, identifiers and the like, and links up to the nodes and thelike. In the described embodiments of the present invention, thereaching time calculation means calculates the time until voicesynthesis of the acquired nodes is executed, from, for example, datasuch as a normal speech speed used by particular voice synthesissoftware or a normal conversation speed, the number of words up to thepredetermined node and the like. The acquired reaching time is storedtemporarily in an appropriate storage area.

At step S14, the method determines display formats in response to thecalculated reaching times with respect to the acquired nodes byreceiving a command from a creator. More particularly, in the presentinvention, as the command inputted by the creator which is illustratedin pseudo code, in order to specify a color, it is possible to input“get color [ ]” to enable to input a color code, and then “#000000”(black) to specify the color. Though, in addition to the above, suchcommands include those for specifying the display formats such as grayscale, half-tone dot meshing, brightness and text display, the presentinvention is not limited to the above described embodiments. Inaddition, in the present invention, it is possible to register a normaldisplay format previously. Next, a process of the content creationmethod continues with step S16, where it reads the nodes, the reachingtimes for the respective nodes, and the structured document intoconversion means, maps the nodes, the reaching times and displaypositions of the nodes on a screen specified by the structured documentto create a time display mapping table, and stores it in the appropriatestorage area. This time display mapping table is used in order to assignthe display formats with respect to display regions of the nodes on aweb page on the screen.

Subsequently, at step S18, the method displays the web page in which thereaching times are reflected, by means of browsing means, and gives theweb page creator visually the reaching times to the nodes. Thereby, themethod makes accessibility for voice browsing with respect to thenon-visual access user comprehensible visually.

FIG. 2 shows a schematic flowchart of a process executed by the reachingtime calculation means of the present invention. The reaching timecalculation means of the present invention causes the targetedstructured document to be read into parser means, at step S20. At stepS22, the reaching time calculation means acquires a DOM (Document ObjectModel) tree structure from the read structured document, and stores theacquired DOM tree structure in the appropriate storage area. It shouldbe noted that as the DOM which may be used in the present invention, inaddition to those in specifications of various kinds of browser softwaresuch as Netscape Navigator® or Internet Explorer®, those which areadapted to a specification given by W3C may be used.

Next, at step S24, data of the stored DOM tree structure is read intospeech node series generation means and intra-page link analysis means.At step S26, the speech node series generation means sorts the nodes inthe DOM tree structure in appropriate order, generates a speech nodeseries to be inputted into the voice synthesis software and stores it inthe appropriate storage area. At step S28, the tags for specifyingintra-page links are analyzed, and then degrees of contributions ofexistences of the intra-page links to the reaching times are calculated,for example, in consideration of effects such as a jump or a skip bymeans of the links, and they are stored in the appropriate storage area.

At step S30, the stored speech node series and the contribution degreesof the intra-page links are read from the storage area, andsimultaneously the speech speed normally used by the voice synthesissoftware, the conversation speed obtained experimentally, and the likeare read, for example, from the storage area. At step S32, the reachingtimes with respect to respective predetermined nodes in the given speechnode series are calculated. At step S34, the acquired nodes areassociated with the reaching times with respect to the nodes, and theyare stored, for example, as a node reaching time table, in the storagearea.

FIG. 3 shows an embodiment of the structured document and a schematicembodiment for creating the node reaching time table in the presentinvention. In FIG. 3, the structured document is described as DHTML. TheDHTML document 10 shown in FIG. 3 is read and parsed by parser means 12,and a DOM tree structure 14 is generated. With respect to the nodesacquired in the DOM tree structure 14, the reaching times for therespective nodes are calculated in reaching time calculation means 16 inthe present invention, by using the normal speech speed read from amemory such as the appropriate memory, a RAM and a ROM. The calculatedreaching times for the respective nodes, for example, t1 to t5, areregistered so as to correspond to the nodes in the DOM tree structure14, and a node reaching time table 18 is generated and stored in theappropriate storage area.

FIG. 4 shows a schematic functional block diagram of a content creationsystem of the present invention. As shown in FIG. 4, the contentcreation system 20 of the present invention includes a database 22having stored the structured document written generally in HTML, DHTML,XML and SGML, an information process section 24 for creating the webpage of the present invention, and a display section 26 provided with ascreen for displaying the created web page and the reaching time to anelement word in case of using the voice browsing, with respect to theweb page creator. In the present invention, the above describedinformation process section may be configured as a computer including astorage area, a central processing unit (CPU), an input/output interfaceand the like.

In addition to the structured document, the database 22 further hasstored image data, audio data and the like for generating the content tobe provided as the web page, and in response to a request from the user,sends the content to the user via a web server not shown, for example,via a network such as the Internet. Furthermore, it is possible to embedvarious kinds of links such as JSP, Servlet, Applet and CGI in thestructured document, so as to provide a WYSIWYG function with respect tothe user. The content creation system 20 of the present invention asshown in FIG. 4, in the described embodiment, is configured separatelyfrom the web server, and described as a dedicated processing device forsupporting the creation or edit of the web page for itself. However, thecontent creation system 20 of the present invention may be included inthe web server 28, as a partial function of the web server 28.

The information process section 24 as shown in FIG. 4 further includes amemory area 30 including the appropriate memory, a hard disk and thelike, a source document editor 32, a WYSIWYG editor 34, a supportprocess section 36 and a browsing process section 38. The storage area30 stores temporarily the structured document stored in the database 22,and also stores results of processes executed by various kinds offunctional blocks temporarily or for as long as required.

The source document editor 32 is configured as a software block whichmay create and edit the structured document such as HTML, DHTML, XML andSGML, for example. The WYSIWYG editor 34 enables to use the variouskinds of links written in the structured document to link the imagedata, the audio data, other documents and the like, and then create andprovide the content in a format desired by the user.

The browsing process section 38 reads the structured documenttemporarily stored from the storage area 30, and displays the contentcreated with reference to the WYSIWYG editor 34 on the screen of thedisplay section 26. The creator recognizes visually the contentdisplayed on the screen, and creates or edits the content interactively.

Furthermore, the support process section 36 in the present invention hasa support function with respect to the creator for visualizing theaccessibility for the non-visual access user. The support processsection 36 reads and analyzes the structured document from the storagearea 30 to acquire the nodes in the DOM tree structure, and uses thenormal speech speed and the like to estimate the times until the nodesare spoken as synthetic voices by the voice synthesis software and thelike installed at a user's terminal. In this case, if the supportprocess section 36 may use the same voice synthesis software as that ofthe user's terminal, the reaching times may be estimated more precisely.

As will be further described below, the support process section 36 usesthe nodes, the reaching times calculated for the respective nodes anddisplay positions on the screen to execute the mapping, generates thetime display mapping table and stores it in the storage area 30.

FIG. 5 shows detailed functional blocks of the support process section36. As shown in FIG. 5, the support process section 36 includes reachingtime calculation means 40, conversion determination means 42 andconversion means 44. Furthermore, the reaching time calculation means 40includes parser means 46, speech node series generation means 48,intra-page link analysis means 50 and calculation means 52. The reachingtime calculation means 40 first reads the structured document from thestorage area 30, parses it in the parser means 46, acquires the nodes inthe structured document, generates the DOM tree structure as a nodehierarchy structure, and stores it in the appropriate storage area 30.The speech node series generation means 48 reads the generated DOM treestructure to extract the nodes, sorts the order of the node series bymeans of a predetermined criteria to create the speech node series, andstores it in the appropriate storage area 30. On the other hand, theintra-page link analysis means 50 determines an intra-page linkstructure in the structured document, calculates necessary times withrespect to the links which contribute to the speech node series, andstores them in the storage area 30.

The calculation means 52 reads the generated speech node series and thecontributions of the links from the storage area 30, as well as thenormal speech speed used by the voice synthesis software from, forexample, the memory or the storage area 30, and then calculates the timefrom starting the voice synthesis until the voice synthesis of the nodeis executed, that is, the reaching time. The calculated reaching timesfor the respective nodes are stored as the above described node reachingtime table by storing them with the corresponding nodes respectively inthe storage area 30.

The conversion determination means 42 determines a display mode and thedisplay format for displaying the reaching time for each nodegraphically. In the present invention, displaying the reaching time in adifferent mode in case of displaying the reaching time on the screen isreferred to as the display mode, and a visual format such as gradationand display color with respect to the reaching time in a predetermineddisplay mode is referred to as the display format. In addition, theconversion determination means 42 receives a command for instructing thedisplay mode, a command for instructing the display format, amodification command for instructing to modify the reaching time(reaching time modification command) and the like, which are inputted bythe creator, and causes the reaching time calculation means 40 and theconversion means 44 to execute the processes corresponding to therespective commands respectively.

Furthermore, in one particular embodiment of the present invention, theconversion determination means 42 may include display format-reachingtime association data. The display format-reaching time association datamay be configured as a table, in which transparency is 100% until apredetermined reaching time and the transparency is decreased as thereaching time becomes late, or in which luminosity of the display coloris lowered gradationally, or the like. In FIG. 5, the above describedembodiment of the display format-reaching time association data is shownas a graph of the reaching time and the transparency.

The conversion means 44 acquires a screen region for displaying in aselected display mode, that is, from the display position of the firstnode in the structured document beginning with an identifier, forexample, a <Body> tag, in the structured document, to the displayposition of the last node to be displayed. Simultaneously, theconversion means 44 receives the command for specifying the displayformat from the conversion determination means 42, and acquires thegradation with reference to the time display mapping table so that thecorresponding node may be displayed, for example, in the gradationdefined by the reaching time of the node. In this phase, by reading thenode reaching time table previously created and registered and using anode identifier attached to the node and the like as a key, theconversion means 44 maps the node, the reaching time and the displayposition to create the time display mapping table.

Subsequently, the conversion means 44 executes a process for insertingnecessary tags with respect to the structured document to create anedited structured document and stores it, for example, in the storagearea 30. This edited structured document is regarded as transient datato be used when a voice browsing function is given in the contentcreation, and is used in order to determine the accessibility for thenon-visual access user through the voice synthesis.

The edited structured document which is inserted with the identifiercorresponding to the display mode, is inputted in the browsing processsection 38. Then the accessibility to the web page, for example, in thecase of executing the voice browsing in a pseudo fashion on the screenof the display section 26 by the browsing process section 38, isdisplayed with respect to the web page creator who is a visual accessuser. It should be noted that the edited structured document created inthe present invention may also be created as the structured document inwhich only tags for giving appropriate display formats are written, andin this case, the display by means of the edited structured document mayalso be overlaid and displayed on the display of the original structureddocument being processed at that time. It should be noted that thedisplay position in the present invention may be represented withposition coordinates on the screen or in units of cursor movements forexecuting the display.

FIG. 6 shows a data structure of a set to be used in the reachingtime-display position mapping as described above, and the displaycorresponding thereto on the screen, in the case of using the DHTMLdocument as shown in FIG. 3. FIG. 6( a) shows an embodiment of thespeech node series, and FIG. 6( b) shows a schematic embodiment of ascreen display displayed by the present invention. As shown in FIG. 6(a), though the speech node series has few words since a relativelysimple DOM tree structure is used, for example, it is assumed that thevoice synthesis software executes the voice synthesis of an E-mailaddress “japanibm@sin-seihin.co.jp”. In addition, it is assumed that thegradation in this range is given the gradation of the transparency of100% by the conversion determination means. FIG. 6( b) shows a screen 60of the display section 26 and a node 62 displayed on the screen 60.

As shown in FIG. 6( b), in the voice synthesis, the node of which thevoice synthesis is executed at the predetermined reaching time, is givenblack gradation so that the node is shown to be hidden. On the otherhand, the node of which the voice synthesis is completed before thepredetermined reaching time, is not given any gradation so that the nodeis shown clearly. Shading on the screen corresponds to the time untilthe non-visual access user acquires the information for external use.Therefore, as shown in FIG. 6, according to the present invention, withrespect to the nodes displayed all over the screen, it may be possibleto recognize visually which time the non-visual access user acquires thetargeted voice synthesis at, as a black region being large or small.

In addition to the above, in another embodiment of the presentinvention, if comprehensibility of speech order of the content isimproved and a page index is used to divide the page into a plurality ofregions, it is possible to employ a configuration which facilitatesdetermination with respect to which intra-page link affects whichelement. Specifically, for example, it is also possible to use anembodiment in which a relation between the intra-page links and thecontent is displayed on the screen and a portion between the intra-pagelinks in the page is displayed to be separated by color as “meaningfulblock of contents”. In this case, the gradation may not be colored blackbut may be colored differently for the respective regions of “meaningfulblock of contents”, and also a boundary portion between the regions maybe displayed with a line.

In addition, in yet another embodiment of the present invention, inaddition to a method of using the colors or the gradation of colors, itis also possible to use a visualization method as will be describedbelow, or to combine these methods properly and use them. A specificembodiment of the visualization method will be described below moreparticularly.

FIG. 7 shows a schematic flowchart of a web page creation support methodof the present invention. The web page creation support method of thepresent invention as shown in FIG. 7, reads the structured document suchas DHTML from the database and generates the DOM tree structure in theparser means at step S50. At the step S52, the method displays the webpage given via HTML by using the generated DOM tree structure, on thescreen of the display section.

At step S54, the method causes the creator to input a signal forselecting the display mode or the display format of the reaching time.To this end, for example, when a menu is displayed by clicking“Modification simulation” menu given as a tool bar, and the creatorselects “Reaching time to main”, a corresponding command is sent to theconversion determination means.

The method of the present invention next continues with a process ofstep S56, where it determines the display mode or the display formatfrom the inputted command, and displays the edited structured documentcreated by the conversion means on the screen to display the reachingtime. At step S58, based on the displayed reaching time, for example,when the creator selects “Reedit” from a menu bar, a reedit command issent to the conversion determination means to cause the informationprocess section to start a reediting process. When the informationprocess section receives the reedit command, it starts to execute thereediting. As one specific embodiment of the reediting process, forexample, it is also possible to instruct to start the source documenteditor and edit directly the structured document being displayed at thattime to insert the link to a main content.

In addition, in the present invention, in consideration of the reachingtime being determined mainly by the speech node series, it is alsopossible to read the speech node series and the structured document fromthe memory area 30 into the source document editor, then insert a string“Do you want to stop speaking the following and jump to the maincontent?” including the link to the main content, with respect to thespeech node series, and simultaneously insert the link at thecorresponding position in the structure document. If there are theintra-page links as described above, the links are sorted so that theorder of the node corresponding to the content of a link destination inthe speech node series corresponds to the position in the structureddocument.

At step S60, the method displays the edited structured document on thescreen and displays the reaching time graphically, and at step S62, itrepeats the above described process until it receives the commandinputted by the creator indicating that the accessibility has beensatisfied. The signals indicating that the accessibility has beensatisfied, in the present invention, may include an end edit command(E), a store command (S) and the like, or the commands for givingequivalent functions corresponding to the above described commands. Atstep S64, the method stores the edited DHTML document in the databaseand the like and enables to provide the web page having the improvedaccessibility for the non-visual access user.

FIG. 8 shows the display of a menu for selecting or determining thedisplay format according to the processes at steps S52 and S54. As shownin FIG. 8, at step S54, when the creator clicks “Modificationsimulation” menu and inputs, the conversion determination means displaysa modification menu. Then, if the creator selects “Reaching time tomain”, a pop-up menu is displayed for selecting the display format from“Gradation of display color” and the like. Furthermore, if the creatorselects “Gradation of display color”, then menu items for inputting“Color selection” are displayed and the command for determining thedisplay format is sent to the conversion determination means.

FIG. 9 shows an embodiment of a graphical display of the reaching timesto the predetermined nodes to be displayed if the process at step S56 ofthe method of the present invention is selected by the creator in aprocedure as shown in FIG. 8. In FIG. 9, the reaching times to therespective nodes are calculated in a sequential order, in the case wherethe page is spoken by means of a voice browser (voice processingsoftware such as a home page reader) from its beginning. In FIG. 9, thereaching times to the respective nodes are displayed by changing thegradations of the respective nodes. In the embodiment shown in FIG. 9,black is selected as the display color and it is shown that the darkerthe black color becomes, the longer the reaching time becomes.

Since FIG. 9 does not have “Direct link to main”, for example in FIG. 9,the most important information Topnews and Recentnews are located in themiddle of the page, and the accessibility for the voice browsing in sucha case is shown. In FIG. 9, since the Topnews and the Recentnews arearranged backward in the speech node series, the main content is shownin the darkest gradation which shows that the accessibility thereto isnot enough. As shown in FIG. 9, by using a graphic display of thepresent invention, it is possible to check visually which portion ismost difficult to access among portions displayed on the screen.

FIG. 10 shows a flowchart of an exemplary procedure of an edit processfor the structured document in the web page creation support method ofthe present invention as shown in step S58. The embodiment shown in FIG.10 illustrates the edit process for the creator or a manager to improvethe accessibility for the non-visual access user without modifying theweb page significantly. In the process of the content creation method ofthe present invention as shown in FIG. 10, the information processsection first reads the structured document such as DHTML and displaysit at step S70. Next at step S72, the creator selects “Modificationsimulation” menu arranged on the screen of the display section, and thenselects “Shorten reaching time to main”.

In the above described process at step S72, it is possible to haveregistered in a field of “Shorten reaching time to main”, for example, acommand for editing the speech node series “edit speech node series []”, or a command for editing the structured document “edit sourcedocument [ ]”, which are illustrated in pseudo code. Thereby it ispossible to edit the speech node series or to edit DHTML directly, asintended by the web page creator.

At step S74, the process displays the reaching time on the screen, andwaits for the creator to select and input the edit process preparedpreviously. At step S74, the edit process prepared previously mayinclude a process of inserting the link at the beginning of the web pageso that the voice synthesis of the element word giving the link to thetargeted main content is executed first, a process of creating the pageindex, and the like. However, in the present invention, any edit processmay be employed as long as it is possible to improve the reaching timeto the main content.

For example, the edit process, with respect to an ALT attribute forexplaining to the non-visual access user about the content such as imagedata, which is unrecognizable for the non-visual access user even if itis presented, may include the edit process for retrieving and extractingthe node in the case where the link to the image data without the ALTattribute is given therein, the node in the case where unnecessary ALTattribute is attached to a spacer image, the node in the case where theALT attribute provided may cause inappropriate readings or confusionwith respect to the non-visual access user, and the like, to displaythem on the screen and the like.

Next, the content creation method of the present invention continueswith the process at step S76, where the method starts the sourcedocument editor, receives the input from the creator, executes the editprocess in response to the input, creates the edited structured documentand stores it in the appropriate storage area at step S78. At step S80,the method displays the edited structured document on the screen via thebrowsing process section, and returns the process to step S62 of FIG. 7,where it enables to reedit the structured document, depending on whetheredit results are reflected on the web page or whether the edit resultsmay give enough accessibility or not.

FIG. 11 shows an embodiment of a graphical user interface to bedisplayed on the screen of the display unit by the content creationsystem of the present invention, by executing the content creationmethod of the present invention as explained in FIG. 10. In FIG. 11,since the web page has not been processed at all in order to improve theaccessibility, and the reaching times are arranged in order of thespeech node series, the element word for enabling the link to the maincontent is arranged in the region which is filled with black indicatingthat the reaching time is late, for example, the region shown with areverse color reference character EC.

Then, the content creation method of the present invention, as shown inFIG. 11, displays a message as follows: “There is no link at thebeginning of this page. Thereby it takes about 220 seconds to access alink to this main content. This page may be modified by two methods asfollows:

-   1: insert a skip-to-main link; and-   2: create a page index (table of contents).”

FIG. 12 shows the screen display in the case where the creator selects 1for editing. In FIG. 12, the creator desires to edit by inserting thelink to the main content. In this case, the content creation system in aparticular embodiment of the present invention selects a plurality ofappropriate link positions automatically with reference to the timedisplay mapping table corresponding to the structured document beingprocessed at that time and the like. Subsequently, the system modifiescolors and highlights of display fields of backward nodes correspondingto the selected link positions, and displays them to the creator. In theembodiment shown in FIG. 12, the information process section analyzesthe time display mapping table and the like to present options for theposition of the main, for example, displays the fields of the backwardnodes in a reverse color.

Simultaneously, the information process section displays a message onthe screen of the display section as follows: “Is there any appropriatemain start position? If so, click the position. If not, click anappropriate main content link position in the page”. Then theinformation process section is controlled in a state for waiting for thecreator to input, for example, “click” and the like. Subsequently, forexample, the screen display such as “Input link destination data or aURL address.” is shown, and the fields for inputting link destinationdata or a URL address are displayed as pop-up.

When the creator clicks the display position of the predetermined nodeon the display screen as shown in FIG. 12, the information processsection acquires the node corresponding to the position on the screen,and then inserts a statement for instructing to execute the skip-to-mainlink, for example, “skip the following explanation and view the maincontent” with respect to the speech node series, immediately prior to adescriptive position of the acquired node in the structured document,and simultaneously inserts a link command for enabling the link, thelink destination data, the URL address and the like, immediately priorto the corresponding node in the structured document. Using the abovedescribed process enables to insert the link at an appropriate reachingtime as well as prevent the creator from missing a description of thelink destination and the like.

In addition, in the present invention, the creator may specify thedisplay position of the main content and insert the corresponding linkto the main content by dragging and dropping the main content at adesired position. Moreover, as a result of the above described editing,it is also possible to have implemented the voice synthesis software inthe information process section and execute speaking of the speech nodeseries, in order to check that the result has been reflected in thesynthetic voice actually.

FIG. 13 shows an embodiment of the graphic display for displayinggraphically the reaching times of the web page in which an appropriatelink to the main content has been formed. As shown in FIG. 13, as aresult of editing the Topnews and the Recentnews according to thepresent invention, they are improved in the accessibility and shown inlighter gradations. As shown in FIGS. 11 to 13, it may be possible forthe creator to create interactively the content in which inappropriateALT attribute settings and the accessibility to an important maincontent are improved, while checking the accessibility on the screen.

FIG. 14 shows an embodiment of another display mode of the reachingtimes which may be employed in the web page creation method of thepresent invention. The display mode shown in FIG. 14 extracts the nodes,the image data, the URL addresses or the likes to be displayed for therespective nodes, arranges the corresponding reaching times and theextracted screen displays in time series, and shows them. In the displaymode shown in FIG. 14, a time axis is assigned to a vertical axis, andvarious kinds of intra-page links are represented as branches of a tree,so that they are represented as height and width of the tree.

In addition, the reaching times shown in FIG. 14( a), in which theinformation is arranged in a line since “skip-to-main link” does notexist, are the reaching times to the nodes in the structured documentwhich has not been edited yet, for example. On the other hand, FIG. 14(b) shows the reaching times in the case where the link to the maincontent is given according to the present invention, and the link isinserted. As shown in FIG. 14( b), the accessibility including the linkfor the user to the Topnews or the Recentnews may be displayed in realtime, and furthermore, the accessibility including the branch on the wayfor the non-visual access user may be checked more visually.

In addition, in another embodiment for visualizing the reaching timeswith the graphical user interface of the present invention, it will bealso necessary to execute visualization display of “unreached regions”which the non-visual access user may not reach. In the presentinvention, the above described unreached regions may be displayed eitherby displaying the regions which the non-visual access user has alreadyreached with the gradation, or by displaying the unreached regions inanother color. Moreover, it is possible to arrange areas of theunreached regions separately, without displaying them on a time tree asdescribed in FIG. 14. For example, in the present invention, an infinitybox 64 may be arranged indicating that the box may not be reachedapparently in time series. In the present invention, a configuration maybe employed in which an unreachable node is displayed within theinfinity box 64. In FIG. 14( b), the infinity box 64 is arranged at thelower right end with respect to FIG. 14( b) as shown, and theunreachable node, for example, “Update notice” is displayed therein.

FIG. 15 shows an embodiment of the content creation system of thepresent invention, in the case where the above described edit process ismodularized as an authoring tool of the web page creation system. In thecontent creation system, generally the authoring tool is provided withseveral modes. In the embodiment shown in FIG. 15, for example, “Design”mode corresponding to the WYSIWYG editor, “Source” mode for editing aHTML source document, and “Preview” mode which may not be edited, areprovided, and they may be configured as functional modules in theinformation process section as shown in FIG. 4. In the embodiment of thepresent invention as shown in FIG. 15, as one of such nodes, forexample, “Blind” mode may be implemented in the information processsection. In the embodiment shown in FIG. 15, it is possible to createthe page by using the Design mode or the Source mode, and start “Blind”mode as a wizard for executing the above described process, in anoperation which is similar to checking the accessibility for the visualaccess user to the page being created during the operation, by means ofthe preview. In the embodiment shown in FIG. 15, it may be possible toimprove the accessibility for the non-visual access user in a flow ofcreating one content.

In addition, in another embodiment of the content creation system of thepresent invention, the information process section for executing theedit process of the present invention may also be configured in the webserver 28, not as the wizard, but as a web application. FIG. 16 shows anembodiment in which the web application for using the present inventionmay be provided. In FIG. 16, the content creation system of the presentinvention is included as the module of a web server 70. The server 70 isconnected via a network 72 to a creator's terminal 74. The server 70uses the browsing process section to establish transactions with thecreator's terminal 74 via the network 72, and executes a task formodifying the desired accessibility for the non-visual access user. Thecreator's terminal 74 manages or maintains the web page or a home pagecreated and managed by the creator. The manager or the creator issupposed to desire to enable the voice browsing with respect to the webpage or the home page which he manages.

FIG. 17 shows an embodiment of the graphical user interface to bedisplayed on the display section of the creator's terminal, in the casewhere a web service is provided via the network by the content creationsystem of the present invention. As shown in FIG. 17, an originalcontent is shown at the left side of the screen, and the accessibilitygenerated from the edited structured document is displayed at the rightside of the screen. Furthermore, at the upper side of the screen of FIG.17, the reaching time for the non-visual access user is displayed withrespect to a beginner user or a senior user. Though there is nodifference essentially between the process with respect to the beginninguser and the process with respect to the senior user, it is possible togive them some consideration so that, for example, an interval betweenthe words in the voice synthesis is lengthened, or a detailedexplanation document is inserted with the link command when the page isedited, and the like.

Simultaneously, it is shown on the screen that an inappropriate ALTattribute “blank” is used which needs to be modified, similarly to theembodiments of FIGS. 11 and 12. In addition, in the embodiment shown inFIG. 17, in consideration of traffic load for providing the web serviceand the like, instead of opening the wizard to execute the process, anactive field such as “Modify settings” is arranged to display editscreens together.

The operation for providing the web service shown in FIG. 17 will bedescribed, assuming that the creator desires to evaluate or modify voiceaccessibility to the web page or the home page which he has created.First, the creator inputs the URL address of the web page or the homepage to be evaluated in a form on the web page provided according to thepresent invention, and submits the form. When the server 70 receives hisrequest, it accesses the URL address to acquire the structured documentand calculates the accessibility. The server 70 renders this resultaccording to the present invention to create data for providing thegraphic display, and sends it to an operator's terminal 74. In thiscase, as shown in FIG. 17, the original content and the editedstructured document may be aligned for comparison.

In addition, a web page creation support system of the present inventionconfigures the information process section as the server, and mayinclude means for recording the speech node series (the display positionin the page—the node identifier) and the time as a service log, in thevoice browser. FIG. 18 shows an embodiment of the web page creationsupport system of the present invention including service log analysismeans. The embodiment shown in FIG. 18 includes the server 70 forproviding the web page, the network 72 such as the Internet connected tothe server 70, and a plurality of users' terminals 74.

The server 70 manages and stores the structured document, for example,such as the DHTML document, stored in the database 76, and provides thecontent in response to the request from the users' terminals 74. In theembodiment explained in FIG. 18, the server 70 further includes aninformation process section 80 as explained in FIGS. 4 and 5 and anaccess log analysis module 78. The access log analysis module 78 readsresults accumulated in an access log to pass the access log to thesupport process section included in the information process section 80of the present invention, and then visualizes the element word and thereaching time until it is accessed, thereby it may be possible tocomprehend the access by the actual user.

Furthermore, in another embodiment of the present invention, it may bepossible to analyze a plurality of user test results (for example, totake an average of them), and see the test results in one view byexecuting the visualization display of them. This may be used as a toolfor checking actual usability, on entering a test process, instead ofauthoring.

The visualization display with respect to a single page has beendescribed heretofore. In the present invention, it is further possibleto display the accessibility across a plurality of pages, for example, aplurality of web pages for the processes such as login, purchase andcheckout in online shopping, by analyzing similarly with respect to theplurality of pages. Embodiments of visualization in this case, forexample, may include a visualization method according to the followingprocesses of:

-   1. in the case of using the color (gradation), arranging the    plurality of pages on space, and executing the visualization display    of them by means of the gradation;-   2. in the case of a spatial arrangement, executing the visualization    display of the plurality of pages, by integrating the respective    time axes across the plurality of pages and extending the tree; and-   3. in the case of a time map, first calculating the reaching times    including other pages and integrating them to configure the map.

Furthermore, in another embodiment of the present invention, a reachabletime has been considered as a factor for determining convenience of theweb page. In addition to that, it is possible to execute thevisualization display including other factors indicating “degree ofinconvenience” other than the reaching time. The other factors, forexample, may include a degree of disjunction between the spatialarrangement and a tag structure, including appropriateness of the ALTattributes such as a dictionary of inappropriate key words and the like,and the number of words and the like, a nested structure of a layouttable and the like. Since these measures do not have values increasinggradually like the reachable time, it is effective to employ anembodiment for displaying the factors by combining with a method ofexpanding only a problematic portion by means of a Fisheye View methodfor example, in addition to the color, the time map and the spatialarrangement.

It is possible to provide the manager or the creator with a morespecific check function by providing the above described visualizationdisplay with interactivity. For example, in the visualization display asexplained in FIG. 12, the reaching time from the beginning of the page(BODY tag beginning position) is calculated and the visualizationdisplay of it is executed statically. In addition, it is also possibleto employ an embodiment for executing the visualization display of thereaching time dynamically, by calculating in real time the reaching timefrom the display position pointed following (or clicked with) a pointingdevice such as a mouse to the display position to which the pointingdevice moves, with reference to the time display mapping table, by meansof a pop-up display and the like.

Furthermore, it is also possible to create a link of “Move to nextportlet” at the beginning of the block of contents to be referred to aseach portlet, by implementing the content creation method of the presentinvention in the information process section, together with softwarewhich allows the creator to combine arbitrary contents to create thepage, such as existing software, WebSphere Portal Server (WPS)®. In thisembodiment, it is possible to check the reaching time to the nextportlet only by moving the cursor with pointer means to each portlet andcalculating the reaching time to the link position.

It may be possible to consider the usability of the voice browsing,easily in an ordinary web page authoring process, by including avisualization function of the present invention in the web pageauthoring tool, without adding another software. Furthermore, thepresent invention integrates various appearances and functions referredto as “View” in many authoring tools into a concept referred to as“View”, and provides it. The present invention may also be configured asone module of the above described “View” functions. Therefore, accordingto the present invention, it is possible to edit one content (HTML, JSPand the like) in its appearance (WYSIWYG editor), fine adjust thecontent at a tag level (source document editor), and check the actualoperation of the content (web browser). Thereby, by providing agraphical user interface function according to the present invention asone of these Views, it may be possible to realize improvement of voiceusability in the authoring process.

Heretofore, though the present invention has been described based on theparticular embodiments shown in the drawings of the present invention,the present invention is not limited to the described particularembodiments. In addition, the system and respective functional portionsof the present invention may be configured as functional means which isrealized by causing the computer to execute a program, therefore it isnot necessarily required to implement them as functional configurationsas shown in the drawings. In addition, programming languages withrespect to the program of the present invention may include C language,C++ language, Java® and the like. In addition, a computer executableprogram of the present invention may be stored and delivered in a ROM,an EEPROM, a flash memory, a CD-ROM, a DVD, a flexible disk, a hard diskand the like.

1. A content creation method for generating a web page with voicebrowsing capability using at least one computer, said method comprisingsteps of: electronically reading a structured document stored in atleast one computer readable storage medium; generating, using the atleast one computer, a speech node series from said structured document;calculating, using the at least one computer, a reaching time as a timefrom starting voice synthesis of the speech node series until voicesynthesis of a predetermined node is executed; associating saidpredetermined node with the reaching time to store said reaching timeand said speech node series; electronically reading said reaching time,and with respect to a display section, electronically generating agraphic display corresponding to the reaching time of said predeterminednode; modifying the graphic display at a display position of saidpredetermined node in connection with the reaching time, wherein thestep of modifying said graphic display in connection with the reachingtime comprises steps of: electronically receiving a modification commandto modify the reaching time to the predetermined node; in response tosaid modification command, modifying the speech node series and saidcorresponding structured document; recalculating, using the at least onecomputer, the reaching time in said modified speech node series; andmodifying the graphic display in connection with the recalculatedreaching time, wherein said step of modifying the graphic display inconnection with the recalculated reaching time comprises a step of:modifying the speech node series at an immediately preceding position ofthe predetermined node specified by said modification command.
 2. Atleast one non-transitory computer readable storage medium havingcomputer readable program code embodied therein that, when executed byat least one computer, performs a method comprising steps of: reading astructured document; generating a speech node series from saidstructured document; calculating a reaching time as a time from startingvoice synthesis of the speech node series until voice synthesis of apredetermined node is executed; associating said predetermined node withthe reaching time to store said reaching time and said speech nodeseries; reading said reaching time, and with respect to a displaysection, rendering a graphic display corresponding to the reaching timeof said node; modifying the graphic display at a display position ofsaid predetermined node in connection with the reaching time, whereinthe step of modifying said graphic display in connection with thereaching time comprises steps of: receiving a modification command tomodify the reaching time to the predetermined node; in response to saidmodification command, modifying the speech node series and saidcorresponding structured document; recalculating the reaching time insaid modified speech node series; and modifying the graphic display inconnection with the recalculated reaching time, wherein said step ofmodifying the graphic display in connection with the recalculatedreaching time comprises a step of: modifying the speech node series atan immediately preceding position of the predetermined node specified bysaid modification command.